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ABSTRACT 



A method and apparatus implementing a separate child 
context for each applet (or similar element) of a browser. A 
described embodiment of the present invention provides one 
or more child contexts that correspond to elements in the 
HTML for a web page displayed by a browser. For example, 
each applet executed by the browser has a corresponding 
and separate child context that points to an associated 
portion of a browser memory. The browser also has a parent 
context, which each child context points to. When a graphic 
is displayed via a widget, the widget draws the graphic (such 
as a panel or a non-pressed button) in the ch'ild context of the 
applet and sets a "damage" flag in the child context. When 
the browser performs its main browser loop, it checks the 
status of the damaged flag for each element (including each 
applet). If the browser finds a damage flag that is set, this 
means that something was written into the portion of the 
browser memory corresponding to the child context and that 
the parent buffer needs updating. In this case, the browser 
"pulls" the information from the portion of browser memory 
corresponding to the child context into the parent buffer, 
which is then used to update the display screen. 

15 Claims, 18 Drawing Sheets 
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APPLET AND APPLICATION DISPLAY IN 
EMBEDDED SYSTEMS USING BUFFERLESS 
CHILD GRAPHICS CONTEXTS 

CROSS REFERENCE TO RELATED 
APPLICATION 

This application is a continuation-in-part of U.S. appli- 
cation Ser. No. 09/203,183 filed Nov. 30, 1998 pending and 
entitled ''Applet and Application Display in Embedded 
Systems Using Child and Orphan Graphics Contexts" which 
is hereby incorporated by reference. This application takes 
priority under 35 U.S.C. §11 9(e) of U.S. patent application 
Ser. No. 60/146,448 filed Jul. 30, 1999 naming Rajesb 
Kanungo, et al. as inventorfs) and assigned to the assignee 
of the present application which is also incorporated herein 
by reference for all purposes. This application is also related 
to the following U.S. patent applications which are herein 
incorporated by reference: 

1) U.S. Pat. No. 6,266,056 filed Nov. 30, 1998 entitled 
"Display Widget Interaction in Embedded Systems 
Using Child Graphics Contexts" of Rajesh Kanungo; 

2) U.S. patent application Sen No. 09/203,224 entitled 
"Method and Apparatus For Modal Dialog Box Man- 
agement In Applets On Information Appliances" of 
Rajesh Kanungo and Juan Carlos Soto, Jr.; 

3) U.S. patent application Ser. No. 09/201,685 filed Nov. 
30, 1998 entitled "TV PIP Applet Using PIP Frame- 
work and Implementation" of Rajesh Kanungo; and 

4) U.S. patent application Ser. No. 09/203,223 filed Nov. 
30, 1998 entitled "TV PIP Using Java API Classes and 
Java Implementation Classes" of Rajesh Kanungo. 

FIELD OF THE INVENTION 

This application relates to a method and apparatus for a 
user interface control and, specifically, to a method and 
apparatus that allows a user to display graphics without 
using a complex windowing system. 

BACKGROUND OF THE INVENTION 

Systems that have embedded programs, such as certain 
information appliances and consumer products, often do not 
contain general purpose windowing or window management 
software. In these systems, all graphics are generally done 
via calls to the built-in graphics routines, such as draw-line, 
draw rectangle, etc. In many conventional systems, graphics 
are drawn via interaction with the browser. Thus, if multiple 
applets are executing as different threads in the browser, they 
will experience a lack of concurrency when performing 
graphics operations. 

SUMMARY OF THE INVENTION 

A described embodiment of the present invention imple- 
ments a separate child context for each applet (or similar 
browser element). A described embodiment of the present 
invention provides one or more child contexts that corre- 
spond to elements in the HTML for a web page displayed by 
a browser. For example, each applet executed by the browser 
has a corresponding and separate child context where each 
child context has a corresponding portion of browser 
memory mapped thereto. The browser also has a parent 
context, which each child context points to. When a graphic 
is displayed via a widget, the widget draws the graphic (such 
as a panel or a non-pressed button) in the child context of the 
applet and sets a "damage" flag in the child context. When 
the browser performs its main browser loop, it checks the 
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status of the damaged flag for each element (including each 
applet). If the browser finds a damage flag that is set, this 
means that something was written into that portion of the 
browser memory mapped to that child context and that the 

s parent buffer needs updating. In this case, the browser 
"pulls" the information from that portion of memory 
mapped to the child context and into the parent buffer, which 
is then used to update the display screen. Thus, several 
separate threads in the JVM can be executing concurrently 

10 and updating graphics elements without interfering with 
each other. 

The invention extends the graphics library routines to 
include (at least) routines to set up, delete, read, and modify 
child contexts and to copy information from child contexts 

15 to parent contexts. The widget library routines are extended 
to include (at least) a parameter identifying the context 
currently being worked on. 

Reactive components present special problems. Reactive 
components are defined as components that must display 

20 interactive behavior. For example, when a user clicks on a 
button on the display screen, the button is momentarily 
displayed as "pressed" and soon thereafter displayed as 
"released." Such interactive behavior gives visual feedback 
to the user. Examples of reactive components include 

25 buttons, lists, choice bars, etc. Present special problems. 
When a widget, for example, a button, needs to show 
interactive behavior (such as going up and down when 
pressed), this behavior must occur very rapidly — often too 
rapidly to necessarily be picked up by a main browser loop, 

30 which executes relatively infrequently. For example, in the 
described embodiment, the main browser loop executes 
approximately every 200 milliseconds (i.e., approximately 
five times per second). In contrast, a "down" button press 
followed by an "up" takes approximately 50 milliseconds. If 

35 the system were to wait for the browser loop, the button 
press would have to last much longer. 

In accordance with the purpose of the invention, as 
embodied and broadly described herein, the invention 
relates to a method of controlling display of graphics data, 

40 comprising: sending a user input event, by a browser to a 
virtual execution environment; providing, in the virtual 
execution environment, a child context corresponding to a 
parent context in the browser and an applet that is executed 
by the browser; writing directly into a portion of a browser 

45 memory associated with the child context, a graphic in 
accordance with the user input event; pulling, by the 
browser, the graphic from the portion of a browser memory 
associated with the child context to the parent context; and 
displaying the graphic stored in the parent context on a 
display screen. 

A fuller understanding of the invention will become 
apparent and appreciated by referring to the following 
description and claims taken in conjunction with the accom- 

55 panying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in 
and constitute a part of this specification, illustrate several 
60 embodiments of the invention and, together with the 
description, serve to explain the principles of the invention. 

FIG. 1(a) is a block diagram of a data processing system 
in accordance with one embodiment of the present inven- 
tion. 

65 FIG. 1(b) is a block diagram of a data processing system 
in accordance with one embodiment of the present inven- 
tion. 
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FIG. 2 shows an example of a set top box system, example, applet software capable of being executed by a 

including a remote unit, and a video display. Java virtual machine (JVM) 108. Storage area 104 prefer- 

FIG. 3(«) is a block diagram of parent and child context abl y also includcs software (not shown) for communicating 

data structures in accordance with an embodiment of the ^ a f tw °' k connection 103, which can be a LAN, WAN, 

resent invention 5 mtranct > or mc mtcrnct - 

prcscn inven ion. A person of ordinary skill in the art will understand that 

FIG. 30) is a diagram showing the relationships between systcm m may alsQ CQntain additional elements, such as 

a browser, exemplary browser elements, and exemplary i npu t/output lines; additional or second input devices, such 

components of a specific browser element. as a keyboard, a mouse, and a voice input device; and 

FIG. 4 is a block diagram of an orphan data structure in display devices, such as a display terminal. System 100 may 

accordance with an embodiment of the present invention. also include a computer readable input device (not shown), 

FIG. 5 is a block diagram showing a main browser loop such as a flo PPy disk drive > CD R ° M f adcr ' a ch f 

and a JVM loop connector, a chip connector, or a DVD reader, that reads 

. - . . . computer instructions stored on a computer readable 

FIG. 6 is a flowchart showing detaUs of the main browser mediuni) such ^ a floppy ^ a CD ROM, a memory chip, 

loop, including refreshing the applets. is or a DVD ^ System 100 also may include application 

FIG. 7 is a flow chart showing details of refreshing the programs, operating systems, data, etc., which are not shown 

applets in the main browser loop. m the figure for the sake of clarity. 

FIG. 8 is a flow chart showing a main JVM loop for In the following discussion, it will be understood that the 

regular non-reactive components. steps of methods and flow charts discussed herein can be 

FIG. 9 is a flow chart showing a main JVM loop for 2 ° performed by processor 102 (or another appropriate 

reactive components, such as a button press. processor) executing instructions stored in storage area 104 

FIG. 10 shows further details of FIGS. 8 and 9. ( or oth f appropriate memories or storage areas). It will also 

„„ . ,. * . ... . c * j . be understood that the invention is not limited to any 

FIG 11 .s a diagram of the architecture of one embodi- parlicular implcmcntation or programmmg technique and 

ment of the present invenUon. 25 ^ [he invemion may be im pi em ented using any appropri- 

FIGS. 12(a) and 12(b) are diagrams of, respectively, a at6 techniques for implementing the functionality described 

pressed button and a released button. herein. The invention is not limited to any particular pro- 

FIG. 13 is a flow chart for orphan context. gramming language or operating system. 

FIG. 14 shows exemplary routines used to implement 3Q The instructions in storage area 104 may be read into 

child and orphan contexts in an embodiment of the present storage area 104 from a computer-readable medium (not 

invention. shown). Execution of sequences of instructions contained in 

FIG. 15 is a block diagram of parent and a bufferless child main memory causes processor 102 (or a similar processor) 

context data structures in accordance with another embodi- to perform the processes described herein. In alternative 

ment of the present invention. 35 embodiments, hard-wired circuitry may be used in place of 

FIG. 16 shows a flowchart describing a process for or * combination with software instructions to implement 

executing an applet in accordance with an embodiment of «"» invention. Thus embodiments of the invention are not 

the invention limited to any specific combination of hardware circuitry 

and software. 

DETAILED DESCRIPTION OF PREFERRED 40 FIG. 1(a) shows a virtual machine (such as a Java virtual 

EMBODIMENTS machine) 108 executing on system 100. FIG. 1(b) is a block 

diagram of a virtual machine that is supported by system 100 
I. General Discussion of FIG ^ md ^ s^ble for implementing the present 
Many conventional World Wide Web browsers are invention. When a computer program, e.g., a computer 
capable of executing Java applets. A Java applet is a com- 45 program written in the Java programming language, is 
puter program written in the Java programming language executed, source code 160 is provided to a compiler 170 
that is designed to execute within a World Wide Web within compiletime environment 155. Compiler 170 trans- 
browser. Such applets are often started when a user clicks on lates source code 160 into bytecodes 180. In general, source 
a button or link in a displayed Web page. Once started, an code 160 is translated into bytecodes 180 at the time source 
applet executes inside the browser, performing whatever 50 code 160 is created by a software developer, 
tasks it has been programmed to perform. "Java" is a Bytecodes 180 may generally be reproduced, 
trademark of Sun Microsystems, Inc. in the United States downloaded, or otherwise distributed through a network, 
and other countries. e.g., network 103 of FIG. 1(a), or stored on a storage device 
FIG. 1(a) is a block diagram of a data processing system such as primary storage 104 of FIG. 1(a). In the described 
100 in accordance with one embodiment of the present 55 embodiment, bytecodes 180 are platform independent. That 
invention. Data processing system 100 can be, for example, is, bytecodes 180 may be executed on substantially any 
a set top box 101 connected to a display device 130, such as, computer system that is running on a suitable virtual 
for example, a television set or some other appropriate machine. 

display device. Data processing system 100 can also be, for Bytecodes 180 are provided to a runtime environment 

example, any other appropriate data processing system. 60 108, which includes virtual machine 190. Runtime environ- 

System 100 includes a processor 102 and a data storage ment 108 may generally be executed using a processor or 

area (e.g., a memory) 104. Data storage area 104 includes processors such as processor 102of FIG. 1(a). Virtual 

certain well-known types of information, such as operating machine 190 includes a compiler 192, an interpreter 194, 

systems U2 and data and data structures 114. In the embodi- and a runtime system 196. Bytecodes 180 may be provided 

ment shown, data and data structures 114 include, for 65 either to compiler 192 or to interpreter 194. 

example, web pages capable of being displayed by a browser When bytecodes 180 are provided to compiler 192, meth- 

106. Data and data structures 114 can also include, for ods contained in bytecodes 180 are compiled into machine 
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instructions. In one embodiment, compiler 192 is a just-in- present invention. In FIG. 3(a), a browser page memory 312 

time compiler, which delays the compilation of methods includes memory for a first applet area (which contains a list, 

contained in bytecodes 180 until the methods arc about to be a button, and a panel) and a second applet area (contents not 

executed. When bytecodes 180 are provided to interpreter shown). The browser memory includes a pointer to a parent 

194, bytecodes 180 are read into interpreter 194 one byte- 5 context data structure 302 for the browser, which includes 

code at a time. Interpreter 194 then performs the operation information about the browser, such as font, foreground and 

defined by each bytecode as each bytecode is read into background color information, and screen coordinates of the 

interpreter 194. That is, interpreter 194 "interprets" byte- browser. The parent context 314 has an associated parent 

codes 180, as will be appreciated by those skilled in the art. memory buffer 318, which includes visual representations of 

When a method is invoked by another method, or is 10 thc screcn mcraory f or the browser, 

invoked from runtime environment 108, if the method is . UT .„ e _ , . 

interpreted, runtime system 196 may obtain the method from H> Each J 1 ™ 1 " * e U J ML f ° r ^ h M ™?LS 

runtime environment 108 in the form of sequences of flayed by the browser has an associated browse element 

bytecodes 180, which may be directly executed by inter- 316. Thus, in the example, each of the first applet and he 

preter 194. If, on the other hand, the method that is invoked second applet have an associated browser element 316. 

is a compiled method that has not been compiled, runtime 15 Other types of elements that may have an associated browser 

system 108 also obtains the method from runtime environ- element include GIFs, JPEGs, etc. 

ment 108 in the form of a sequence of bytecodes 108, which Each browser element points to a child context 302 in the 

then may go to activate compiler 192. Compiler 194 then JVM. Only one child context 302 is shown in the figure for 

generates machine instructions from bytecodes 180, and the tne sa ^ e 0 f c i ar ity, but in the described embodiment, each 

resulting machine-language instructions may be executed 20 browser element (and therefore each applet) has an associ- 

directly by processor 102 (or other appropriate processors). alcd child ccmtext , Th e child context 302 includes informa- 

In general, the machine-language instructions are discarded ^ abom i(s ,^^1^ app i et> such as f onl> foreground and 

when virtual machine 109 terminates. The operation of blckground color information, and screen coordinates of 

virtual machines or more Particularly Java virtua information displayed by the applet. The child context of an 

machines is described m more detail in The Java Wtual 25 ^ ako { JJ es a > d ? fl 350f which indicatcs 

re nG nC 2 shows an example of a set top box system, md | cates ^ e ther the applet conUins a reactive element 

including a set top box 101 connected to a television 130 and 30 *«* " ^Tl^ " u 2* w ? f f 5 

a remote unit 120. Remote unit 120, which is used as an " associated child memory buffer 304, which includes 

input device, is not shown to scale. An actual remote unit is visual representations of the screen memory for the browser, 

generally of a size appropriate to fit in a user's hand. The described embodiment does not use a graphics sys- 

Similarly, set top box 101 and television 120 are not tem such as an X Server or Motif. Instead, it uses direct 

necessarily shown to scale. Certain embodiments of the graphic routines implemented along with child and parent 

present invention can also be used with a keyboard or with contexts. These direct graphics routines write directly into 

an infrared or other wireless keyboard (not shown). the graphics buffers of the parent and/or child contexts. A 

It will be understood that the button arrangement shown graphics Java object 310 points to a graphics peer object 

on remote unit 120 are for purposes of example only and are 308, which is an abstract class. A DWL (developer's widget 

not to be interpreted in a limiting sense. Remote unit 120 library) object is a subclass of class 308. An example of thc 

includes a "web" button, a "mail button, a "home" button, a 40 rj^L graphics object could be a button widget. The DWL 

"goto" button, a "fave" button, a "back" button, a "control" grap hics object points to the child context 302 for the applet 

button, arrow buttons, and a "select" button. As will be that cootams me object. 

appreciated, a conventional use of back button is to d^phy ^ each Jaya && 

a previously displayed web page. Similarly, a conventional * . c . 

use of "goto" button is to allow the user to specify and view 45 one or more separate threads in the JVM. Thus each Java 

a new web page. The arrow buttons allow the user to move applet «n modify its child context 302 and its child memory 

a cursor between various elements on web page 304, as is independently from the other applets. As shown in FIG. 6, 

known to persons skilled in the art. a main browser loop periodically polls the executing applets 

In FIG. 2. a button 204, a list and a panel are displayed on 10 determine whether anv of their fla f. are u sel ' 

a web page displayed on display device 130. It will be 50 FIG. 3(b) is a diagram showing the relationships between 

understood that these elements 304 are generated on a web * browser, exemplary browser elements, and exemplary 

page under control of an applet (not shown), such as applet components of a specific browser element. A browser dis- 

110 of FIG 1(a) plays HTML elements such as applets, GIFs, JPfcUs and 

Network connection 103 allows the set lop box to com- frames - Cerlain clements > ™ ch "W*** can include graph- 

municate with a network, such as the internet, an intranet, a 55 1CS components such as buttons, lists, choices, or panels. As 

LAN or a WAN. Network connection can also be a wireless showD > in f elements such as «u tons lists, and choices 

are examples of reactive components that require an mter- 

•_. c -j • active output when they are pressed or selected by the user. 

Video hue 207 provides a source of v t deo mput to set op J ^ do ^ J 

box 101 Une 206 couples the set top box 101 to the <hsp ay ^ ^ ^ ^ ^ ^ 

device 130 to convey video and audio output signals to the ou , 

display device 130. The signals on line 206 could be, for FIG - 4 * a ?>J ock dia f am of an J* 1 ™ dala stnjcture m 

example, one or more of, S-video signals, composite signals, accordance with an embodiment of the present invention 

component signals, or audio signals, or HDTV signals. Orphan contexts are used in situations where some <behmd 

the scenes" drawing needs tot be done. An orphan context is 

II. Detailed Discussion 65 s i m ji ar to a child context (and can be a special case of a child 

FIG. 3(a) is a block diagram of parent and child context context) but is not associated with any particular applet or 

data structures in accordance with an embodiment of the other element. Instead, as shown in FIG. 13, the content of 
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an orphan context is transferred to a child buffer and the the DWL component widget corresponding to the peer, and, 

damage flag of the child buffer is set so that the main in step 814, the event is delivered to the DWL (Developer's 

browser loop will eventually pick up the graphics change, widget library) component (see FIG. 14). In step 816, the 

Orphan contexts cannot be drawn directly on the screen. DWL component draws the graphic in the child buffer in 

They can only be copied to another context (such as a child 5 accordance with the event. This step is described in more 

context). detail in FIG. 10, which describes a method used for both 

FIG. 5 is a block diagram showing a main browser loop reactive and non-reactive components, 

and a JVM loop. As is shown in the Figure, these loops FIG. 9 is a flow chart showing a main JVM loop for 

include a main browser loop (which is performed by reactive components, such as a button press. As discussed 

browser 106 of FIG. 1). A main JVM loop 504 is performed 10 above, a reactive component cannot wait for the main 

by JVM 108. A key event queue 510 receives "key events," browser loop. In the described embodiment, the main 

for example, key presses from remote unit 206 and queues browser loop of FIG. 7 executes every 200 milliseconds, 

them for input to main browser loop 502. AJVM queue 508 Similarly, the described reactive events, such as a button 

receives "JVM events " from the main browser loop and press are required to take place in approximately 50 milli- 

queues them for input to main JVM loop 504. In the 15 seconds. The steps of FIG. 9 are similar to those of FIG. 8, 

described embodiment, each of loops 502 and 506 are except that, in step 918, the JVM twice writes directly into 

implemented as a thread executed by processor 102. the child and the parent contexts. Thus, the JVM directly 

FIG. 6 is a flowchart showing details of the main browser writes the "pressed" button graphic and the "released" 

loop, including periodic refreshing of executing applets. In button graphic without waiting for the main browser loop, 

step 602, the main loop receives a key press from a key event 20 Step 918 sets the Recursive Update flag, draws two graphics 

queue. A key press can be the result of the user pressing a images into the child and parent buffers, and clears the 

key on the remote 120 or the result of clicking or selecting Recursive Update flag. This is described in more detail in 

a button or similar component displayed on the screen by an connection with FIG. 10. 

applet. If in step 602, the current key event is an event for FIG. 10 shows further details of FIGS. 8 and 9. If the 

an applet, an event is placed on the JVM queue 508 via step 25 method of FIG. 10 is called from FIG. 8 (a non-reactive 

608. Otherwise, an appropriate activity is performed for the component), the Recursive Update flag will not be set. If, on 

key event. In either case, the main browser loop refreshes the the other hand, the method of FIG. 10 is called from FIG. 9 

graphics display of any executing applets, as shown in FIG. (a reactive component), the Recursive Update flag will have 

7. (It will be appreciated that other activities occur in the been set in step 918. 

main browser loop, but have been omitted from the descrip- Thus, for a non-reactive component, in step 1002 the 

tion for the sake of clarity). widget issues a call (such as, for example, an aglBeginPaint 

FIG. 7 is a flow chart showing details of refreshing the call shown in FIG. 14), which sets the damage flag in the 
applets in the main browser loop. In an initial step 702, child context. Because the recursive update flag is not set, 
control waits until the parent context is unlocked. In some 35 control passes to step 1004. In step 1004, the DWL corn- 
situations, the parent context will already be unlocked. ponent object draws a graphics for the received JVM event 
Locking of the parent context occurs when some other in the child buffer. Because the recursive update flag is not 
thread needs to access the parent context or wants to keep set, control passes to step 1006 and then to step 1008. Thus, 
the parent context from being accessed. In the described for a non-reactive component, the component object draws 
embodiment, this lock is implemented as a unix mutex lock. &Q the correct graphic in the child buffer and sels the damage 
One example of how the parent might become locked is flag in the child context. The change in graphics will be 
shown in step 1002 of FIG. 10. picked up in the main browser loop as shown in FIG. 7. 

The steps of FIG. 7 loop through the active applets to For a reactive component, in step 1002 the widget issues 

determine whether its damage flag is set. If, in step 704, the an aglBeginPaint call (see FIG. 14), which sets the damage 

damage flag of a current applet is set, control passes to step 45 flag in the child context (even though this is not required, it 

706. Otherwise, control passes to step 712. In step 706, the is harmless). Because the recursive update flag is set, a lock 

browser locks the parent and child contexts (so not other is also placed on the parent context and buffer and on the 

threads can change them during steps 708-710). In step 708, child context and buffer. Such a lock means that only the 

the browser "pulls" graphics data from the child context 302 locking thread can change the contexts until they are 

and child memory 304 of the applet to the parent context 314 50 unlocked. Control passes to step 1004. In step 1004, the 

and parent memory 318 of the browser. In the described DWL component object draws a first graphic for the 

embodiment, this step is performed via a call to a routine received JVM event in the child buffer (such as a "pressed" 

called aglPutContext, which is described in connection with button shown in FIG. 12(a)). Because the recursive update 

FIG. 14. flag is set, the DWL component object also draws the 

FIG. 8 is a flow chart showing a main JVM loop for 55 graphics for the received JVM event in the parent buffer, 

regular non-reactive components, such as a panel, or other Thus, the change to the parent buffer will automatically be 

display element that does not require an interactive behavior. reflected on the display screen without having to wait for the 

In the described embodiment, the steps of FIG. 8 are main browser loop. Control passes to step 1006 and then to 

performed by the JVM 108. In step 802, the JVM receives step 1009, which clears the locks. Step 1010 waits some 

an event from the JVM event queue. Events in this queue can 60 approximate time, such as 50 milliseconds, which is long 

be sent from the browser or from some other source. An enough for a human user to notice that the button appearance 

example of such a non-reactive event might be "draw a nas changed. 

panel." Steps 804-812 locate a Java AWT widget that has Steps 1012-1016 perform similar steps to draw a second 

focus (i.e., that has been chosen to receive the input from graphic (such as a "released" button shown in FIG. 12(b)) 

remote 120 or a similar keyboard). The event is delivered to 65 directly into the parent and child buffers and contexts. Thus, 

a Java widget, which invokes the abstract event handler code for a reactive component, the component object draws a first 

and the actual component code for the peer. Step 812 locates graphic in the child and parent buffers, waits some prede- 
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termined period of time, and draws a second graphics in the 
parent and child buffers. Reactive graphics do not wait for 
the change in graphics will be picked up in the main browser 
loop as shown in FIG. 7. If the main browser loop occa- 
sionally happens to redraw the second graphic, no harm is 
done. 

FIG. 11 is a diagram of the architecture of one embodi- 
ment of the present invention. It includes the extended AGL 
and DWL routines mentioned above. 



It is important to note that each Java applet executes as 
one or more separate threads in the JVM. Thus, each Java 
applet can modify its child context 1502 and its correspond- 
ing portion of parent buffer memory 1513 independently 
from the other applets. 

Referring now to FIG. 16, a flowchart describing a 
process 1600 for executing an applet in accordance with an 
embodiment of the invention. The process 1600 begins at 
1602 by a browser requesting that an associated Java Virtual 



FIG. 13 is a flow chart for orphan context. The steps are 10 Machine (JVM) launch an applet. A determination is made 



similar to those of FIG. 8, but in step 1316, the orphan 
context must be copied to a child context (or a parent 
context, not shown) where it will eventually be displayed. 
Orphan context are used, for example, when there is a need 



at 1604 whether or not the requested applet has in fact been 
created. If it is determined that the requested applet has not 
been created, then control is passed to 1606 directing that the 
JVM create the requested applet. In creating the requested 



to draw a graphic "offscreen," such as sometimes occurs for J5 applet, the JVM creates a corresponding bufferless child 



JPEGs and GIFs. Similarly, if a graphic will be duplicated 
once it is drawn, it is often advantageous to use an orphan 
context. 

FIG. 14 shows exemplary AGL routines used to imple- 



context at 1608. In the case where, at 1604, the requested 
applet has been determined to be created or the JVM has just 
created the requested applet at 1606, the applet is started by 
the JVM at 1610. Once the applet has been started by the 



ment child and orphan contexts in an embodiment of the 20 JVM at 1610, the applet runs until such time as a slop 

present invention. These routines include but are not limited command is as determined at 1612 is received. While a stop 

to: aglCreateChildContext, aglDeleteChildContext, command has not been received and the applet is therefor 

aglBeginPaint, aglEndPaint, aglCreateOrphanContext, running, the applet draws in to that portion of the buffer 

aglPutContext, and aglContextRedrawn. memory that maps to the bufferless child context and the 

In another embodiment of the invention, a bufferless child 25 duplicate clip region at 1614. At 1616, the child context is 

context can be employed as shown in FIG. 15 that illustrates marked as dirty and control is passed back to 1612 in both 

a block diagram of parent and child context data structures. the JVM and browser loop for determining whether or not a 

In FIG. 15, a browser page memory 1512 includes a portion stop command has been received. If the stop command has 

of memory 1513 for a first applet area (which contains a list, been received, then the document reference counter is dec- 

a button, and a panel) and a second applet area (contents not 30 remented at 1618 and a determination at 1620 is made 

shown). The browser page memory 1512 includes a pointer whether or not the reference counter ig equal zero. If the 

1515 to aparent context data structure 1514 for the browser reference counter is not equal zero, then the process 1600 

106, which includes information about the browser, such as stops, otherwise, when the reference counter is equal to zero, 

font, foreground and background color information, and then control is passed to 1622 where the bufferless child 

screen coordinates of the browser. The parent context 1514 35 context is removed. 

has an associated parent memory buffer 1518, which In summary, he described embodiment of the present 

includes visual representations of the screen memory for the invention provides one or more bufferless child contexts that 

browser. correspond to elements in the HTML for a web page 

Each element in the HTML for a page currently being displayed by a browser. For example, each applet executed 

displayed by the browser has an associated browser element *c b y browser has a corresponding and separate child 

1516. Thus, in the example, each of the first applet and the context where each child context draws into a portion of 

second applet has an associated browser element 1516. memory that maps directly to that bufferless child context. 

Other types of elements that may have an associated browser The browser also has a parent context, which each child 

element include GIFs, JPEGs, etc. context points to. When a graphic is displayed via a widget, 

Each browser clement points to a child context 1502 in the 45 the widget draws the graphic (such as a panel or a non- 
JVM. Only one child context 1502 is shown in the figure for Pressed button) in the child context of the applet and sets a 
the sake of clarity, but in the described embodiment, each 
browser element (and therefore each applet) has an associ- 
ated child context. The child context 1502 includes infor- 
mation about its associated applet, such as font, foreground 50 
and background color information, and screen coordinates 
of information displayed by the applet. The child context 
1502 of an applet also includes a damage flag 1550, which 
indicates whether the contents of the child buffer have been 

changed (akin to a "dirty bit) and a Recursive Update flag 55 f«nng with each other. 

1552, which indicates whether the applet contains a reactive • The invention extends the AGL (Applications graphics 

element, such as a button, list, or choice. It is important to library) routines to include (at least) routines to set up, 

note that in this particular embodiment of the invention, the delete, read, and modify child contexts and to copy infor- 

child context 1502 does not have an associated child mation from child contexts to parent contexts. The DWL 

memory buffer but includes, instead, a pointer 1517 to the 60 (developer's widget library) routines are extended to include 

portion 1513 of the browser page memory buffer 1512. In a parameter identifying the context currently being worked 
this way, the performance of the browser is appreciably 
enhanced due to the fact that visual representations of the 
screen memory for the browser heretofore stored in the child 

buffer 304 are stored directly in the portion 1513 of the 65 
browser memory 1512, which when needed, is pulled 
directly to the parent memory buffer 1518. 



"damage" flag in the child context. When the browser 
performs its main browser loop, it checks the status of the 
damaged flag for each element (including each applet). If the 
browser finds a damaged flag that is set, it "pulls" the 
information from the child buffer into the parent buffer 
memory, which is used to update the display screen. Thus, 
several separate threads in the JVM can be executing 
concurrently and updating graphics elements without inter- 



on. The browser has been extended to implement the func- 
tionality of checking the damage flag of buffer of the parent 
context. 

Reactive components, such as buttons, lists, choice bars, 
etc. Present special problems. When a widget, for example, 
a button, needs to show interactive behavior when pressed 
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(like going up and down), this behavior must occur very 
rapidly — too rapidly to necessarily be picked up by a main 
browser loop, which executes relatively infrequently. Thus, 
a child context cannot update the display properly for a 
reactive component if it merely marks the child context as 
damaged and waits for the browser loop. 

While the invention has been described in conjunction 
with a specific embodiment, it is evident that many 
alternatives, modifications and variations will be apparent to 
those skilled in the art in light of the foregoing description. 
Accordingly, it is intended to embrace all such alternatives, 
modifications and variations as fall within the spirit and 
scope of the appended claims and equivalents. 

What is claimed is: 

1. A method of controlling display of graphics data, 
comprising: 

sending a user input event, by a browser to a virtual 
execution environment; 

providing, in the virtual execution environment, a child 
context corresponding to a parent context in the 
browser and an applet that is executed by the browser; 

writing directly into a portion of a browser memory 
associated with the child context, a graphic in accor- 
dance with the user input event; 

pulling, by the browser, the graphic from the portion of 
the browser memory associated with the child context 
to the parent context; and 

displaying the graphic stored in the parent context on a 
display screen. 

2. A method as recited in claim 1, wherein the user input 
event is a reactive graphics component including one of a 
button, list, and choice. 

3. A method as recited in claim 1, wherein the user input 
event is a nonreactive graphics component including a 
panel, the non-reactive graphics component requiring non- 
interactive behavior. 

4. A method as recited in claim 1, wherein the child 
context further includes a damage flag and a recursive 
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20 
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dance with the graphics event, the parent buffer 
being used for displaying the graphic data on a 
display screen; 
waiting a predetermined amount of time; 
writing directly into the portion of the browser memory 

associated with the child context and the buffer of the 

parent context by the virtual execution environment, a 

second graphic in accordance with the graphics event to 

be displayed on the display screen; 

providing an orphan context for behind the scenes 
drawing wherein contents of the orphan context 
being indirectly drawn on a display screen via the 
portion of memory associated with the child context; 

pulling, by the browser, the graphic from the child 
context to the parent context; 

returning execution control to the browser for the 
virtual execution environment; and 

displaying the graphic stored in the parent context on 
the display screen. 

7. A method as recited in claim 6, wherein the virtual 
execution environment provides applications graphics 
library (AGL) routines, including a child context set up 
routine, a child context delete routine, a child context read 
routine, a child context modify routine, and a routine for 
copying information from the child context to the parent 
context. 

8. A method as recited in claim 7, wherein the method 
further includes invoking a routine, the routine being one of 
the AGL routines. 

9. A method as recited in claim 6, wherein the applet is 
one of multiple applets executed as different threads by the 
browser, each of the applets being associated with a child 
context, each child context corresponding to the parent 
context. 

10. A method as recited in claim 9, wherein each child 
context corresponds to a browser element displayed on the 
display screen. 

11. Amethod as recited in claim 10, wherein each browser 



update flag, the damage flag for indicating whether contents 40 element is associated with an HTML element for a page 



of the buffer of the portion of memory associated with the 
child context has changed, and the recursive update flag for 
indicating whether the applet contains a reactive element. 

5. A method as recited in claim 1, further comprising 45 
providing a second child context in the virtual execution 
environment, corresponding to the parent context in the 
browser, where the child context corresponds to a second 
applet that is executed by the browser. 

6. A method of controlling display of graphics data, 
comprising: 

sending a graphics event by a browser to a virtual execu- 
tion environment, 

providing, in the virtual execution environment, a buff- 
erless child context corresponding to a parent context 
having a parent buffer associated therewith in the 
browser and an applet that is executed by the browser, 
wherein the bufferless child context is associated with 
a portion of a browser memory; 

writing directly to the portion of the browser memory 
associated with the bufferless child context by the 
virtual execution environment, a first graphic in accor- 
dance with the graphics event, providing an interactive 
behavior if the graphic event is reactive including: 
writing into a buffer of the parent context, by the virtual 
execution environment, the first graphic in accor- 



50 
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displayed on the display screen. 

12. A method as recited in claim 6, wherein the child 
context further includes a damage flag indicating whether 
the corresponding portion of the browser memory has been 
changed. 

13. A method as recited in claim 6, wherein the child 
context further includes a recursive update flag indicating 
whether the associated applet contains a reactive element. 

14. An apparatus that controls display of graphics data, 
comprising: 

software circuitry configured to send a user input event, 
by a browser to a virtual execution environment; 

software circuitry configured to provide in the virtual 
execution environment, a child context corresponding 
to a parent context in the browser and an applet that is 
executed by the browser; 

software circuitry configured to write directly into a 
portion of a browser memory associated with the child 
context, a graphic in accordance with the user input 
event; 

software circuitry configured to pull, by the browser, the 
graphic from the portion of a browser memory associ- 
ated with the child context to the parent context and 

software circuitry configured to display the graphic stored 
in the parent context on a display screen. 
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15. A computer program product, comprising: 

a computer usable medium having computer readable 

code embodied therein for controlling the display of 

graphics data, comprising: 
a computer readable program code configured to cause a 

user input event to be sent by a browser to a virtual 

execution environment; 
computer readable program code configured to cause a 

child context to be provided in the virtual execution 10 

environment, the child context corresponding to a 

parent context in the browser and an applet that is 

executed by the browser; 
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computer readable program code configured to cause a 
widget library component to write directly into a por- 
tion of a browser memory associated with the child 
context, a graphic in accordance with the user input 
event; 

computer readable program code configured to pull, by 
the browser, the graphic from the portion of a browser 
memory associated with the child context, to the parent 
context; and 

computer readable program code configured to display the 
graphic stored in the parent context on a display screen. 
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